Conversation
Codeowners resolved as |
|
✨ Fix all issues with BitsAI or with Cursor
|
48f6699 to
4776fdc
Compare
f56e4f1 to
9128420
Compare
9128420 to
09485da
Compare
Performance SLOsComparing candidate munir/llm-rc-support (1b29979) with baseline main (62e5bae) 📈 Performance Regressions (2 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 103.315µs (SLO: <130.000µs 📉 -20.5%) vs baseline: +2.1% Memory: ✅ 44.072MB (SLO: <46.000MB -4.2%) vs baseline: +5.2% ✅ add_inplace_aspectTime: ✅ 100.360µs (SLO: <130.000µs 📉 -22.8%) vs baseline: -0.4% Memory: ✅ 43.932MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ add_inplace_noaspectTime: ✅ 28.337µs (SLO: <40.000µs 📉 -29.2%) vs baseline: +0.6% Memory: ✅ 43.967MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ add_noaspectTime: ✅ 49.075µs (SLO: <70.000µs 📉 -29.9%) vs baseline: ~same Memory: ✅ 43.949MB (SLO: <46.000MB -4.5%) vs baseline: +5.1% ✅ bytearray_aspectTime: ✅ 250.926µs (SLO: <400.000µs 📉 -37.3%) vs baseline: +0.9% Memory: ✅ 44.048MB (SLO: <46.000MB -4.2%) vs baseline: +5.1% ✅ bytearray_extend_aspectTime: ✅ 649.664µs (SLO: <800.000µs 📉 -18.8%) vs baseline: -0.2% Memory: ✅ 44.032MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ bytearray_extend_noaspectTime: ✅ 263.611µs (SLO: <400.000µs 📉 -34.1%) vs baseline: -0.3% Memory: ✅ 43.854MB (SLO: <46.000MB -4.7%) vs baseline: +4.7% ✅ bytearray_noaspectTime: ✅ 138.739µs (SLO: <300.000µs 📉 -53.8%) vs baseline: +1.4% Memory: ✅ 43.948MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ bytes_aspectTime: ✅ 218.688µs (SLO: <300.000µs 📉 -27.1%) vs baseline: +0.4% Memory: ✅ 44.243MB (SLO: <46.000MB -3.8%) vs baseline: +5.6% ✅ bytes_noaspectTime: ✅ 131.436µs (SLO: <200.000µs 📉 -34.3%) vs baseline: -0.2% Memory: ✅ 43.912MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ bytesio_aspectTime: ✅ 3.769ms (SLO: <5.000ms 📉 -24.6%) vs baseline: -0.3% Memory: ✅ 43.990MB (SLO: <46.000MB -4.4%) vs baseline: +5.2% ✅ bytesio_noaspectTime: ✅ 315.031µs (SLO: <420.000µs 📉 -25.0%) vs baseline: ~same Memory: ✅ 43.931MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ capitalize_aspectTime: ✅ 88.008µs (SLO: <300.000µs 📉 -70.7%) vs baseline: -0.5% Memory: ✅ 43.861MB (SLO: <46.000MB -4.7%) vs baseline: +4.7% ✅ capitalize_noaspectTime: ✅ 248.675µs (SLO: <300.000µs 📉 -17.1%) vs baseline: +1.0% Memory: ✅ 43.949MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ casefold_aspectTime: ✅ 88.457µs (SLO: <500.000µs 📉 -82.3%) vs baseline: +0.6% Memory: ✅ 44.032MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ casefold_noaspectTime: ✅ 299.994µs (SLO: <500.000µs 📉 -40.0%) vs baseline: -1.2% Memory: ✅ 43.974MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ decode_aspectTime: ✅ 86.774µs (SLO: <100.000µs 📉 -13.2%) vs baseline: +0.1% Memory: ✅ 44.188MB (SLO: <46.000MB -3.9%) vs baseline: +5.4% ✅ decode_noaspectTime: ✅ 151.987µs (SLO: <210.000µs 📉 -27.6%) vs baseline: -1.1% Memory: ✅ 43.913MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 84.145µs (SLO: <200.000µs 📉 -57.9%) vs baseline: ~same Memory: ✅ 44.072MB (SLO: <46.000MB -4.2%) vs baseline: +4.8% ✅ encode_noaspectTime: ✅ 139.627µs (SLO: <200.000µs 📉 -30.2%) vs baseline: -0.7% Memory: ✅ 43.759MB (SLO: <46.000MB -4.9%) vs baseline: +4.6% ✅ format_aspectTime: ✅ 14.675ms (SLO: <19.200ms 📉 -23.6%) vs baseline: +0.2% Memory: ✅ 44.285MB (SLO: <46.000MB -3.7%) vs baseline: +5.3% ✅ format_map_aspectTime: ✅ 16.387ms (SLO: <21.500ms 📉 -23.8%) vs baseline: +0.2% Memory: ✅ 44.040MB (SLO: <46.000MB -4.3%) vs baseline: +4.7% ✅ format_map_noaspectTime: ✅ 373.403µs (SLO: <500.000µs 📉 -25.3%) vs baseline: +0.3% Memory: ✅ 43.928MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ format_noaspectTime: ✅ 303.647µs (SLO: <500.000µs 📉 -39.3%) vs baseline: +0.3% Memory: ✅ 43.936MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ index_aspectTime: ✅ 138.691µs (SLO: <300.000µs 📉 -53.8%) vs baseline: 📈 +12.3% Memory: ✅ 44.083MB (SLO: <46.000MB -4.2%) vs baseline: +5.2% ✅ index_noaspectTime: ✅ 40.485µs (SLO: <300.000µs 📉 -86.5%) vs baseline: +0.2% Memory: ✅ 43.952MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ join_aspectTime: ✅ 210.421µs (SLO: <300.000µs 📉 -29.9%) vs baseline: ~same Memory: ✅ 44.165MB (SLO: <46.000MB -4.0%) vs baseline: +5.5% ✅ join_noaspectTime: ✅ 141.862µs (SLO: <300.000µs 📉 -52.7%) vs baseline: -1.0% Memory: ✅ 43.878MB (SLO: <46.000MB -4.6%) vs baseline: +4.9% ✅ ljust_aspectTime: ✅ 498.647µs (SLO: <700.000µs 📉 -28.8%) vs baseline: -0.4% Memory: ✅ 44.047MB (SLO: <46.000MB -4.2%) vs baseline: +5.1% ✅ ljust_noaspectTime: ✅ 267.928µs (SLO: <300.000µs 📉 -10.7%) vs baseline: +4.9% Memory: ✅ 43.928MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ lower_aspectTime: ✅ 296.338µs (SLO: <500.000µs 📉 -40.7%) vs baseline: +0.1% Memory: ✅ 44.002MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ lower_noaspectTime: ✅ 231.051µs (SLO: <300.000µs 📉 -23.0%) vs baseline: +0.2% Memory: ✅ 43.952MB (SLO: <46.000MB -4.5%) vs baseline: +5.1% ✅ lstrip_aspectTime: ✅ 0.278ms (SLO: <3.000ms 📉 -90.7%) vs baseline: +0.6% Memory: ✅ 44.009MB (SLO: <46.000MB -4.3%) vs baseline: +5.3% ✅ lstrip_noaspectTime: ✅ 0.176ms (SLO: <3.000ms 📉 -94.1%) vs baseline: +0.7% Memory: ✅ 43.973MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ modulo_aspectTime: ✅ 14.289ms (SLO: <18.750ms 📉 -23.8%) vs baseline: ~same Memory: ✅ 44.153MB (SLO: <46.000MB -4.0%) vs baseline: +4.9% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.786ms (SLO: <19.350ms 📉 -23.6%) vs baseline: -0.4% Memory: ✅ 44.305MB (SLO: <46.000MB -3.7%) vs baseline: +5.2% ✅ modulo_aspect_for_bytesTime: ✅ 14.420ms (SLO: <18.900ms 📉 -23.7%) vs baseline: +0.2% Memory: ✅ 44.071MB (SLO: <46.000MB -4.2%) vs baseline: +4.9% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.636ms (SLO: <19.150ms 📉 -23.6%) vs baseline: +0.2% Memory: ✅ 44.051MB (SLO: <46.000MB -4.2%) vs baseline: +5.0% ✅ modulo_noaspectTime: ✅ 0.353ms (SLO: <3.000ms 📉 -88.2%) vs baseline: -1.2% Memory: ✅ 43.914MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ replace_aspectTime: ✅ 18.420ms (SLO: <24.000ms 📉 -23.2%) vs baseline: ~same Memory: ✅ 44.108MB (SLO: <46.000MB -4.1%) vs baseline: +5.0% ✅ replace_noaspectTime: ✅ 280.726µs (SLO: <400.000µs 📉 -29.8%) vs baseline: ~same Memory: ✅ 43.911MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ repr_aspectTime: ✅ 322.373µs (SLO: <420.000µs 📉 -23.2%) vs baseline: +1.0% Memory: ✅ 44.064MB (SLO: <46.000MB -4.2%) vs baseline: +5.2% ✅ repr_noaspectTime: ✅ 46.763µs (SLO: <90.000µs 📉 -48.0%) vs baseline: -0.4% Memory: ✅ 43.912MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ rstrip_aspectTime: ✅ 387.675µs (SLO: <500.000µs 📉 -22.5%) vs baseline: -0.7% Memory: ✅ 44.074MB (SLO: <46.000MB -4.2%) vs baseline: +5.3% ✅ rstrip_noaspectTime: ✅ 180.446µs (SLO: <300.000µs 📉 -39.9%) vs baseline: -0.6% Memory: ✅ 43.841MB (SLO: <46.000MB -4.7%) vs baseline: +4.4% ✅ slice_aspectTime: ✅ 185.405µs (SLO: <300.000µs 📉 -38.2%) vs baseline: +0.2% Memory: ✅ 44.073MB (SLO: <46.000MB -4.2%) vs baseline: +5.1% ✅ slice_noaspectTime: ✅ 54.752µs (SLO: <90.000µs 📉 -39.2%) vs baseline: +0.4% Memory: ✅ 44.012MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ stringio_aspectTime: ✅ 4.402ms (SLO: <5.000ms 📉 -12.0%) vs baseline: 📈 +16.4% Memory: ✅ 43.972MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ stringio_noaspectTime: ✅ 344.273µs (SLO: <500.000µs 📉 -31.1%) vs baseline: -0.8% Memory: ✅ 43.846MB (SLO: <46.000MB -4.7%) vs baseline: +4.6% ✅ strip_aspectTime: ✅ 274.690µs (SLO: <350.000µs 📉 -21.5%) vs baseline: -0.2% Memory: ✅ 44.130MB (SLO: <46.000MB -4.1%) vs baseline: +5.4% ✅ strip_noaspectTime: ✅ 174.882µs (SLO: <240.000µs 📉 -27.1%) vs baseline: ~same Memory: ✅ 43.893MB (SLO: <46.000MB -4.6%) vs baseline: +5.0% ✅ swapcase_aspectTime: ✅ 332.969µs (SLO: <500.000µs 📉 -33.4%) vs baseline: +0.4% Memory: ✅ 43.775MB (SLO: <46.000MB -4.8%) vs baseline: +4.4% ✅ swapcase_noaspectTime: ✅ 266.550µs (SLO: <400.000µs 📉 -33.4%) vs baseline: -1.0% Memory: ✅ 43.951MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ title_aspectTime: ✅ 318.401µs (SLO: <500.000µs 📉 -36.3%) vs baseline: -1.1% Memory: ✅ 44.167MB (SLO: <46.000MB -4.0%) vs baseline: +5.4% ✅ title_noaspectTime: ✅ 252.931µs (SLO: <400.000µs 📉 -36.8%) vs baseline: -0.6% Memory: ✅ 43.776MB (SLO: <46.000MB -4.8%) vs baseline: +4.5% ✅ translate_aspectTime: ✅ 493.754µs (SLO: <700.000µs 📉 -29.5%) vs baseline: +0.2% Memory: ✅ 43.872MB (SLO: <46.000MB -4.6%) vs baseline: +4.8% ✅ translate_noaspectTime: ✅ 419.834µs (SLO: <500.000µs 📉 -16.0%) vs baseline: -1.2% Memory: ✅ 43.933MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ upper_aspectTime: ✅ 294.798µs (SLO: <500.000µs 📉 -41.0%) vs baseline: +0.4% Memory: ✅ 43.947MB (SLO: <46.000MB -4.5%) vs baseline: +5.1% ✅ upper_noaspectTime: ✅ 230.314µs (SLO: <400.000µs 📉 -42.4%) vs baseline: ~same Memory: ✅ 43.839MB (SLO: <46.000MB -4.7%) vs baseline: +4.7% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 506.819µs (SLO: <700.000µs 📉 -27.6%) vs baseline: 📈 +20.1% Memory: ✅ 43.977MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ ospathbasename_noaspectTime: ✅ 430.666µs (SLO: <700.000µs 📉 -38.5%) vs baseline: ~same Memory: ✅ 43.890MB (SLO: <46.000MB -4.6%) vs baseline: +5.1% ✅ ospathjoin_aspectTime: ✅ 626.786µs (SLO: <700.000µs 📉 -10.5%) vs baseline: +0.5% Memory: ✅ 43.809MB (SLO: <46.000MB -4.8%) vs baseline: +4.8% ✅ ospathjoin_noaspectTime: ✅ 631.415µs (SLO: <700.000µs -9.8%) vs baseline: +0.2% Memory: ✅ 43.969MB (SLO: <46.000MB -4.4%) vs baseline: +5.7% ✅ ospathnormcase_aspectTime: ✅ 348.569µs (SLO: <700.000µs 📉 -50.2%) vs baseline: -0.6% Memory: ✅ 43.974MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ ospathnormcase_noaspectTime: ✅ 358.312µs (SLO: <700.000µs 📉 -48.8%) vs baseline: -0.3% Memory: ✅ 43.797MB (SLO: <46.000MB -4.8%) vs baseline: +4.9% ✅ ospathsplit_aspectTime: ✅ 481.863µs (SLO: <700.000µs 📉 -31.2%) vs baseline: -0.9% Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +4.4% ✅ ospathsplit_noaspectTime: ✅ 494.461µs (SLO: <700.000µs 📉 -29.4%) vs baseline: +0.3% Memory: ✅ 43.971MB (SLO: <46.000MB -4.4%) vs baseline: +5.4% ✅ ospathsplitdrive_aspectTime: ✅ 372.254µs (SLO: <700.000µs 📉 -46.8%) vs baseline: -0.2% Memory: ✅ 43.861MB (SLO: <46.000MB -4.7%) vs baseline: +5.0% ✅ ospathsplitdrive_noaspectTime: ✅ 72.291µs (SLO: <700.000µs 📉 -89.7%) vs baseline: -0.8% Memory: ✅ 43.934MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ ospathsplitext_aspectTime: ✅ 457.551µs (SLO: <700.000µs 📉 -34.6%) vs baseline: -0.1% Memory: ✅ 43.952MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ ospathsplitext_noaspectTime: ✅ 462.337µs (SLO: <700.000µs 📉 -34.0%) vs baseline: -0.3% Memory: ✅ 43.916MB (SLO: <46.000MB -4.5%) vs baseline: +5.1% 🟡 Near SLO Breach (6 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 19.690ms (SLO: <22.300ms 📉 -11.7%) vs baseline: -0.1% Memory: ✅ 70.446MB (SLO: <73.500MB -4.2%) vs baseline: +4.8% ✅ exception-replay-enabledTime: ✅ 1.327ms (SLO: <1.450ms -8.5%) vs baseline: ~same Memory: ✅ 68.280MB (SLO: <71.500MB -4.5%) vs baseline: +4.8% ✅ iastTime: ✅ 19.800ms (SLO: <22.250ms 📉 -11.0%) vs baseline: ~same Memory: ✅ 70.494MB (SLO: <75.000MB -6.0%) vs baseline: +5.0% ✅ profilerTime: ✅ 15.130ms (SLO: <16.550ms -8.6%) vs baseline: ~same Memory: ✅ 60.363MB (SLO: <61.000MB 🟡 -1.0%) vs baseline: +4.8% ✅ resource-renamingTime: ✅ 19.644ms (SLO: <21.750ms -9.7%) vs baseline: -0.4% Memory: ✅ 70.433MB (SLO: <73.500MB -4.2%) vs baseline: +4.8% ✅ span-code-originTime: ✅ 20.040ms (SLO: <28.200ms 📉 -28.9%) vs baseline: +0.7% Memory: ✅ 70.157MB (SLO: <75.000MB -6.5%) vs baseline: +5.0% ✅ tracerTime: ✅ 19.750ms (SLO: <21.750ms -9.2%) vs baseline: +0.4% Memory: ✅ 70.389MB (SLO: <75.000MB -6.1%) vs baseline: +4.8% ✅ tracer-and-profilerTime: ✅ 22.439ms (SLO: <23.500ms -4.5%) vs baseline: -0.1% Memory: ✅ 72.111MB (SLO: <75.000MB -3.9%) vs baseline: +4.8% ✅ tracer-dont-create-db-spansTime: ✅ 19.769ms (SLO: <21.500ms -8.1%) vs baseline: -0.6% Memory: ✅ 70.442MB (SLO: <75.000MB -6.1%) vs baseline: +4.9% ✅ tracer-minimalTime: ✅ 16.883ms (SLO: <17.500ms -3.5%) vs baseline: +0.3% Memory: ✅ 70.117MB (SLO: <75.000MB -6.5%) vs baseline: +4.9% ✅ tracer-nativeTime: ✅ 19.668ms (SLO: <21.750ms -9.6%) vs baseline: +0.8% Memory: ✅ 70.419MB (SLO: <72.500MB -2.9%) vs baseline: +4.8% ✅ tracer-no-cachesTime: ✅ 17.626ms (SLO: <19.650ms 📉 -10.3%) vs baseline: +0.4% Memory: ✅ 70.126MB (SLO: <75.000MB -6.5%) vs baseline: +4.7% ✅ tracer-no-databasesTime: ✅ 19.407ms (SLO: <20.100ms -3.4%) vs baseline: +0.7% Memory: ✅ 70.135MB (SLO: <75.000MB -6.5%) vs baseline: +4.9% ✅ tracer-no-middlewareTime: ✅ 19.428ms (SLO: <21.500ms -9.6%) vs baseline: ~same Memory: ✅ 70.109MB (SLO: <75.000MB -6.5%) vs baseline: +4.8% ✅ tracer-no-templatesTime: ✅ 19.841ms (SLO: <22.000ms -9.8%) vs baseline: +2.4% Memory: ✅ 70.355MB (SLO: <73.500MB -4.3%) vs baseline: +4.9% 🟡 errortrackingflasksqli - 6/6✅ errortracking-enabled-allTime: ✅ 2.081ms (SLO: <2.300ms -9.5%) vs baseline: ~same Memory: ✅ 58.864MB (SLO: <60.000MB 🟡 -1.9%) vs baseline: +4.9% ✅ errortracking-enabled-userTime: ✅ 2.088ms (SLO: <2.250ms -7.2%) vs baseline: -0.1% Memory: ✅ 58.825MB (SLO: <60.000MB 🟡 -2.0%) vs baseline: +4.8% ✅ tracer-enabledTime: ✅ 2.074ms (SLO: <2.300ms -9.8%) vs baseline: ~same Memory: ✅ 58.884MB (SLO: <60.000MB 🟡 -1.9%) vs baseline: +4.8% 🟡 flasksimple - 18/18✅ appsec-getTime: ✅ 3.390ms (SLO: <4.750ms 📉 -28.6%) vs baseline: +0.8% Memory: ✅ 59.079MB (SLO: <66.500MB 📉 -11.2%) vs baseline: +5.0% ✅ appsec-postTime: ✅ 2.866ms (SLO: <6.750ms 📉 -57.5%) vs baseline: +0.1% Memory: ✅ 59.090MB (SLO: <66.500MB 📉 -11.1%) vs baseline: +4.7% ✅ appsec-telemetryTime: ✅ 3.371ms (SLO: <4.750ms 📉 -29.0%) vs baseline: +0.8% Memory: ✅ 58.967MB (SLO: <66.500MB 📉 -11.3%) vs baseline: +4.8% ✅ debuggerTime: ✅ 1.876ms (SLO: <2.000ms -6.2%) vs baseline: ~same Memory: ✅ 49.309MB (SLO: <51.500MB -4.3%) vs baseline: +5.0% ✅ iast-getTime: ✅ 1.868ms (SLO: <2.000ms -6.6%) vs baseline: ~same Memory: ✅ 46.028MB (SLO: <49.000MB -6.1%) vs baseline: +4.8% ✅ profilerTime: ✅ 1.914ms (SLO: <2.100ms -8.9%) vs baseline: -0.5% Memory: ✅ 52.394MB (SLO: <53.500MB -2.1%) vs baseline: +4.8% ✅ resource-renamingTime: ✅ 3.343ms (SLO: <3.650ms -8.4%) vs baseline: +0.2% Memory: ✅ 59.086MB (SLO: <60.000MB 🟡 -1.5%) vs baseline: +5.1% ✅ tracerTime: ✅ 3.349ms (SLO: <3.650ms -8.2%) vs baseline: ~same Memory: ✅ 58.970MB (SLO: <60.000MB 🟡 -1.7%) vs baseline: +4.8% ✅ tracer-nativeTime: ✅ 3.350ms (SLO: <3.650ms -8.2%) vs baseline: +0.3% Memory: ✅ 59.191MB (SLO: <60.000MB 🟡 -1.3%) vs baseline: +5.2% 🟡 flasksqli - 6/6✅ appsec-enabledTime: ✅ 2.076ms (SLO: <4.200ms 📉 -50.6%) vs baseline: -0.1% Memory: ✅ 58.923MB (SLO: <66.000MB 📉 -10.7%) vs baseline: +4.8% ✅ iast-enabledTime: ✅ 2.080ms (SLO: <2.800ms 📉 -25.7%) vs baseline: ~same Memory: ✅ 58.923MB (SLO: <62.500MB -5.7%) vs baseline: +4.6% ✅ tracer-enabledTime: ✅ 2.068ms (SLO: <2.250ms -8.1%) vs baseline: -0.1% Memory: ✅ 59.022MB (SLO: <60.000MB 🟡 -1.6%) vs baseline: +5.1% 🟡 forktime - 4/4✅ baselineTime: ✅ 1.943ms (SLO: <3.000ms 📉 -35.2%) vs baseline: +3.7% Memory: ✅ 29.216MB (SLO: <33.000MB 📉 -11.5%) vs baseline: +4.6% ✅ configuredTime: ✅ 9.425ms (SLO: <13.000ms 📉 -27.5%) vs baseline: +0.2% Memory: ✅ 59.033MB (SLO: <60.000MB 🟡 -1.6%) vs baseline: +4.6% 🟡 recursivecomputation - 8/8✅ deepTime: ✅ 311.688ms (SLO: <320.950ms -2.9%) vs baseline: +0.2% Memory: ✅ 37.552MB (SLO: <38.750MB -3.1%) vs baseline: +5.2% ✅ deep-profiledTime: ✅ 332.782ms (SLO: <359.150ms -7.3%) vs baseline: ~same Memory: ✅ 43.785MB (SLO: <46.000MB -4.8%) vs baseline: +4.6% ✅ mediumTime: ✅ 7.298ms (SLO: <7.400ms 🟡 -1.4%) vs baseline: ~same Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.0% ✅ shallowTime: ✅ 1.017ms (SLO: <1.050ms -3.2%) vs baseline: +1.1% Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +4.5%
|
Description
Staging POC (M0) for LLMObs 1-click enablement via Remote Configuration.
New:
ddtrace/llmobs/product.py— LLMObs RC product that hooks into the existingAPM_TRACINGRC flow:apm_tracing_rcreceivesllmobs.enabled/llmobs.ml_app_namefrom RC and callsLLMObs.enable()/LLMObs.disable()at runtime without a restart_track_enabled_llm_integrationstags the RCclient_tracerwith active LLM integrations so the backend can identify LLM-capable services for 1-click enablementddtrace/llmobs/_llmobs.py— splitsSUPPORTED_LLMOBS_INTEGRATIONS(LLM frameworks) from_INTEGRATIONS_W_PROPAGATION_SUPPORT(HTTP adapters)ddtrace/internal/settings/_config.py— registers_llmobs_enabledand_llmobs_ml_appin_default_config()so RC can override them via the standard config precedence chainTesting
No tests yet — M0 is validated manually on staging.
Risks
1<<48is a placeholder; must be confirmed with dd-go before GALLMObs.enable()is called from the RC poll thread (pre-existing thread-safety limitation)Additional Notes
Requires backend changes in dd-go: extend
LibConfigwithllmobs.enabled/llmobs.ml_app_nameand confirm capability bit.